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Sampling of stochastic operators 


GOTZ E. PFANDER, PAVEL ZHELTOV 


Abstract. We develop sampling methodology aimed at determining stochastic 
operators that satisfy a support size restriction on the autocorrelation of the operators 
stochastic spreading function. The data that we use to reconstruct the operator (or, 
in some cases only the autocorrelation of the spreading function) is based on the 
response of the unknown operator to a known, deterministic test signal. 


1. Introduction 


In wireless and wired communication, in radar detection, and in signal processing 
it is usually assumed that a signal is passed through a filter, whose parameters have 
to be determined from the output. Commonly, such systems are modeled with a 
time-variant linear operator acting on a space of signals. For narrow-band signals, 
we can model the effects of Doppler shifts and multi-path propagation as the sum 
of “few” time-frequency shifts that are applied to the sent signal. In general, the 
channel consists of a continuum of time-frequency scatterers: the channel is formally 
represented by an operator with a superposition integral 



( 1 ) 


where T t is a time-shift by t, that is, Ttf(x) = /(x — t), t £ R, M y is a frequency 
shift or modulation given by M v f(x) = e 2mux /( x), i/eK. We define the Fourier 
transform of a function /( x) to be 


nm) = = /(o = J Hx) e - 2 ™« d* 


It follows that 


M„/(£) = m - v) = T„/(0- 


The function ij(t, v) is called the (Doppler-delay) spreading function of H. 

To identify the operator means to determine the spreading function 77 of H from 
the response Hf(x) of the operator to a given sounding signal f{x). The not 
necessarily rectangular support of the spreading function is known as the occupancy 
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pattern, and its area as spread of the operator H. The fundamental restriction for 
the spread to be less than one has been shown to be necessary and sufficient for 
the identifiability of channels [12, 4, 24, 29]. This extends results on classes of 
underspread operators that are defined as those with rectangular occupancy pattern 
of area less than one. 

This extension of the class of underspread channels to operators with spread 
less than one is particularly of interest in the field of sonar communication [14] 
and in the multiple input-single output channel settings. Acoustic channels possess 
larger spreads than radar and wireless channels. This is due to the speed of sound 
being magnitudes lower than that of electromagnetic waves, resulting in time 
delays up to several seconds and Doppler spreads in the tens of Hertz for high- 
frequency channels [2] . Another type of channels with large values for the area of 
the occupancy pattern are multiple input - single output (MIMO) channels; they 
combine several deterministic spreading functions into one channel, thus covering a 
larger region of the time-frequency plane [26] . 

In recent work, the identifiability results [12, 4, 16, 29] have been recast within 
the framework of operator sampling [28, 24]. For example, in [28], concrete 
reconstruction formulas for deterministic operators are established, that satisfy the 
spread constraints mentioned above, and which resemble the Whittaker-Shannon 
interpolation formula In this paper, we develop operator sampling in the stochastic 
setting and give analogous reconstruction formulas. 

Taking into account the random nature of real-world communication environ¬ 
ments, we model such channels with stochastic time-variant operators [10, 12, 3, 4]. 
In this setting, the spreading function r](t, v) of the operator H in (1) is a random 
process^ indexed by (t, v) that is to be recovered from the output process Hf{x) 
indexed by x. For the purposes of this paper, it would be enough to think of rj(t, v, lj) 
as a (t, (/[-indexed family of random variables on a common probability space Q, or 
as a random process with instances from L 2 (R 2 ). 

In the sibling paper [25] we develop and use the theory of stochastic modulation 
spaces to rigorously define and prove identification results for operators with spread¬ 
ing functions belonging to a class of generalized random processes — including 
delta functions and white noise. The norm inequalities that are proven there are 
essential to justify use of delta trains as sounding signals. However, in this paper, 
we are going to ignore these subtleties and treat distributions on par with Lebesgue 
integrable functions, for ease of exposition only. The fine points of the underlying 
mathematical analysis will be mentioned in a few side remarks. 

1.1. Operator sampling theory in the historical perspective. The progress of op¬ 
erator identification theory largely follows the evolution of the related theory of 
function sampling. The two major directions of generalization are the introduction 
of stochasticity (stationary and non-stationary) and the removal of the require¬ 
ment that the “bandlimitation” is rectangular. For convenience, we summarize this 
development in Table 1. 

For example, based on the classical Shannon-Nyquist sampling theorem, a corre¬ 
sponding result for bandlimited stationary stochastic processes was proven in great 


f Here, and in remainder of the paper, random functions and operators are denoted by boldface 
characters, x is a complex conjugate of x, x* conjugate transpose. E stands for expectation, and // for 
both 2D area and 4D volume. 
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Table 1. Development of function and operator sampling. 


generality by Lloyd [20] . We cite it here in the form given in a classic book by 
Papoulis. 

Theorem 1. [23, p. 378] If a stationary process x(t) is bandlimited, that is, if its 
power spectral density S(£) = IF T ^,(E{x{t)x(t + r)} is integrable and suppS'(^) C 
[—f2/2, fi/2], then we can recover x(t) in the mean-square sense from the samples 
taken at rate fl = T -1 . In fact, 


N 


x(t] = 1 . i. m. 

AT->oo 


Y x(nT) 

n=—N 


sin7rf2(f — rcT) 
7rf l{t — nT) 


The requirements of stationarity and the bandlimitation of the spectrum to 
the symmetric interval were later relaxed by Kluvanek and Lloyd. In his 1963 
groundbreaking paper [12], Kailath realized that for a deterministic time-variant 
channel to be identifiable, it is necessary and sufficient that the product LIT of 
the maximum time delay T and maximum Doppler spread Q is not greater than 
one. Since, channels were called underspread whenever LIT < 1, and overspread if 
LIT > 1 [37]. The insight of Kailath has been generalized and formalized by Kozek 
and Pfander. 

Following in Kailath footsteps, the seminal paper of Bello lays the groundwork 
for channel sampling and characterization tools and vocabulary. In the sequel [4] 
Bello further argues that it is not the product DT that matters for identification 
of a deterministic time-variant channel, but rather the spread, or the area of what 
he calls an occupancy pattern, that is, the not necessarily rectangular support of 
the spreading function supp p. In particular, Bello’s assertion has been put into a 
rigorous mathematical framework and was proven using novel tools from Gabor 
analysis by Pfander and Walnut. Also, the ideas developed in [3] were used to 
estimate the capacity of the channels with non-rectangular spread [7] . 

A brief comment of Kailath [12] suggests sufficiency of DT < 1 for the identifi¬ 
cation of stationary stochastic channels as well as deterministic, and Bello treats 
this question as a side matter, more interested in developing the estimator for rj(f, u) 
when the output has been contaminated by additive noise. 
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As with the development of function sampling, a simpler stationary model for 
operator identification has seen most research. The channel has the property of wide- 
sense stationarity with uncorrelated scattering (WSSUS), that is, the autocorrelation 
function of rj(t , v) has the form 

Rri(t, v; t', v') =E{rj(t,is)ri(t\is')} 

= 5(t — t') 8(v — v') C v (t , v). 

In other words, taps at different delays are uncorrelated and stationary. The function 
Cri(t, v) is known as the scattering function of H . It completely characterizes the 
second-order statistics of r] and represents the power spectral density of the transfer 
function of the channel. This means that the scattering function represents the 
expected behavior of the operator. Two common types of methods to identify the 
scattering function are deconvolution and direct measurement methods [1, 9, 21, 
13]. In [32] we apply the methodology developed here and in [25] to study WSSUS 
channels in depth. Theorem 16 below guarantees identifiability of a WSSUS channel 
whenever its scattering function is merely compactly supported. 

In this paper, we address a more general problem of stochastic spreading function 
reconstruction and stochastic operator sampling and identification for not necessarily 
WSSUS channels. 

1.2. Overview of the paper. Deterministic identification results in [16, 29] allow 
for the recovery of the deterministic spreading function whenever its support has 
area less than one. We discuss this in detail in Section 2.1. It is easy to see that 
in the case of a stochastic spreading function, such deterministic reconstruction 
formulas are still applicable to each random variate, allowing for the recovery of 
an instance spreading function rj(t, zqw) from the response H(uj)f{x), where to is an 
element of the sample space 12. However, on its own, each instance will provide 
little information about the average behavior of the operator H. Secondly, it is 
possible that the 4-dimensional volume of the support of the 4D autocorrelation 
function Rrft, v; t', z/) is less than one, while some instances r)(t , u\ to) have 2D area 
greater than one. 

The contributions of this paper follow. In Section 2.3 we consider the case 
when the 4-dimensional autocorrelation function R n (t,u-,l/,v') of the operators’ 
spreading function is supported on a 4D region U = supp v\ t 1 , v’) that can be 
expressed as a tensor product of some 2D region S with itself. In this scenario, we 
prove that it is possible — and give an explicit reconstruction formula (10) — to 
recover the stochastic spreading function of the channel in the mean-square sense 
from the response Hf of a channel to a periodic weighted delta train, provided 
that the set S occupies a region of area less than one. This case will include 
the special case deterministic operators as their autocorrelation functions satisfy 
R v (t, v; t', v’) = p(t, v) v’). 

In Section 2.4 the case of an arbitrary support region U = suppf? TJ (t, v;t\ v’) 
is considered. With some abuse of nomenclature, we will also say that we can 
(stochastically) identify a stochastic operator if we can recover the 4-dimensional 
autocorrelation function li ri (t, i/; t’. v r ) (and not the stochastic spreading function, 
as in the previous case) from the autocorrelation function of the response Hf of 
the channel to a periodically weighted delta train (and not the stochastic response 
itself). In Theorem 12 we prove that in this sense we can identify the operator H 
provided that the support pattern of the autocorrelation function is permissible. 
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Analogous to the deterministic criterion p(S) < 1, the requirement p{U) < 1 is 
also necessary for stochastic identifiability of a stochastic operator, as we show in an 
sibling paper [25]. In this paper, we demonstrate patterns that correspond to regions 
of 4D volume less than one but are nonetheless unidentifiable by our methods. 

Permissibility of a pattern is a geometric property linking the operator sampling 
theory to finite Gabor frame theory. After giving preliminary remarks on Gabor 
frames in finite dimensions in Section 1.3 below, in Section 3 we show that the sup¬ 
port patterns of the the autocorrelation functions of the operators are in one-to-one 
correspondence with the column subsets of special Gabor frames. We provide a (par¬ 
tial) classification of the autocorrelation patterns and analyze several phenomena 
that emerge for Gabor frames of higher dimension Section 3.1 and Section 3.2. 

1.3. Finite-dimensional Gabor frames. A deterministic operator is a particular 
case of the stochastic operator with a degenerate probability distribution, so the 
results for stochastic operator identification must necessarily be compatible with 
the deterministic ones. In the theory of deterministic operator identification, the 
existing operator identification proofs pivot on the so-called Haar property of Gabor 
frames. A finite-dimensional Gabor frame in C L is defined as 



( 2 ) 


where the finite-dimensional translation operators T fc and modulation operators M” 
operating on a vector c £ C L are given by 


T k c[p\ = c[p - k} and M n c[p\ = e 2mnp/L c\p\. 


(3) 


A frame has the Haar property whenever its elements are in general linear position, 
that is, any subset of L elements is linearly independent. A finite-dimensional Gabor 
frame G generated by window c as defined in (2), has the Haar property for almost 
every choice of window c, given that the ambient dimension L is prime [18]. 

Application of our methods to the stochastic case spawns a more peculiar Gabor 
frame on Zx Ll, the properties of which differ in the key respect of linear 
independence of its subsets. In particular, such a frame has small subsets that are 
linearly dependent for any choice of window c, even when the parameter L is prime. 


2. Operator sampling 


2.1. Deterministic operators. Equivalently to (1), any operator H acting on one- 
variable signals can be represented with its symbols, 

(1) its time-vaiying impulse response h(x, t) = f pit, v) then 



(2) its kernel n(x, t) = h{x, x — t) = J p(x — t, v) e 


dv, then 



(3) and its Kohn-Nirenberg symbol a{x, £) = F t ^h{x, t), then 
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All these symbols of H can be transformed into each other using partial Fourier trans¬ 
forms and area-preserving shears, such as X 2 f(x , t ) = f(x +1, x ) [11]. In particular, 
the spreading function and the Kohn-Nirenberg symbol are related through 

<r(x,Q = Tsrifav), 

where the symplectic Fourier transform is given by 

(FsV) (x,£) = JJ v(t, v) e - 2 -(— it) dt du _ 

In the following, it will sometimes be advantageous to present the results with h, 
k, or a instead of ?/ and we will not hesitate to do so. However, we formulate our 
results primarily with 77 due to its particularly simple relationship to the short-time 
Fourier transform. On the Schwartz dual space S' of tempered distributions, we 
define the short-time Fourier transform to be 

V v f(t,v) = (f, M v T t <p) 

for any <p in the Schwartz space S. Then for all f,ip £ S we have the useful equality 

= <? hVftp). 

The inner product (•, •) is taken to be conjugate linear in the second variable. 

We will say that FI belongs to an operator Paley-Wiener space if the support of 
the spreading function r/(t, v) = iF s a(x, £) is contained in a compact subset of the 
time-frequency plane, 

OPW(S) = |fT: L 2 (R) —► L 2 (R), such that a £ L 2 (R 2 ) with suppler C S'j. 

Colloquially, we refer to H as “bandlimited.” to S. 

The connection of the operator sampling theory to the more established function 
sampling is best observed on the following theorem for Hilbert-Schmidt operators 
with the spreading function supported on a rectangle in the time-frequency plane. 
An operator H: L 2 (R”) -a L 2 (K") is Hilbert-Schmidt (H £ HS(R n )) whenever its 
spreading function r](t, v) £ L 2 (R 2n ). 

Theorem 2. [24, Theorem 1.2] For H £ HS(R) such that supp r](t,u) C [0, T) x 
[—0/2, FI/ 2] and HT < 1 we have 

11-^ ^ fcT II z, 2 (m) = t|I 7 ?IIl2(r2), 

fcez 

and H can be reconstructed by 

\—^ sin 7 rT(a; — n) 

K.{x + t,x) = V flm (i + nT)——-—, 

t— 1 7 r f lx — n) 

ngZ v ' 

with convergence in L 2 (R 2 ). Here and in the following, we denote S a (t) = S(t — a). 

Note that if FT is a multiplication operator with a bandlimited multiplier, Theo¬ 
rem 2 reduces to the classic Shannon sampling theorem. 

Remark. In order to accommodate delta functions and other generalized functions 
as identifiers we require that rj(f, v) is a mapping from the dual M°°(]R 2 ) of the 
Feichtinger algebra M 1 (M 2 ) into the Hilbert space of zero-mean random variables 
RV(J7). Here, the modulation space M 1 (R”) is defined via the finiteness of the norm 



Sampling of stochastic operators 


7 


\\f\\ w ( S „.) = \\Vgf\\ L1 ( R2 n) < oo, where L^R") is the space of Lebesgue integrable 
functions, and M 00 ^ 11 ) = (M 1 (K ra ))' is its continuous dual [11]. 

Functional analytic arguments of [16, 30, 24, 25] show that whenever rj(t, v) is 
compactly supported (which is a physically reasonable assumption taken here) it 
is possible to extend the domain of H from L 2 to the whole of M°° and further to 
the Wiener amalgam space W (J r L°°(K 2d ), f 1 ). Therefore, r](t, v) is well-defined as a 
linear functional on the corresponding predual space W(TL 1 (R 2d ), £°°) that includes 
certain tempered distributions, in particular, weighted delta trains m c = Y^ke z Cfc <^t 
as input for H. 

Below, Theorem 5 gives a deep generalization of Theorem 2. It provides guar¬ 
antees for recovery of those operators whose spreading function is supported on a 
set of arbitrary shape — not just a rectangle — as long as the area of the support 
is less than one. Additionally, it shows that it is possible to replace smx/x with 
smooth functions with better decay through the use of partitions of unity generated 
by continuous functions. For a, e > 0 we say r(t) generates an ( a,e)-partition of 
unity {r(f + ak)}ke z whenever 

r(t ) = 0 if t ^ (—e, a + e) and r(t + ak) = 1. 

fee z 

Definition 3. The set S is (a, b , A)-rectified if it can be covered by L = ^ translations 
A = {(kj,n.j)}j-Q of the rectangle □ = [0, a) x [0, b) along the lattice aZ x bZ: 

L -1 

S C □ 4- (akj, brij). 

o 

Lemma 4. For any compact set S of measure p(S) < 1 contained within [0, T) x 
[—ft/2, fi/2] there exist a, b > 0 and A such that S is (a, b, A)-rectified, L = ^ is 
prime, a < ^ and b < 

Proof This is a standard result from a theory of Jordan domains. A proof can be 
found in [8]. Any compact set with Jordan content less than one can be covered 
with L rectangles of cumulative area L ■ ^ = 1, and it is easy to see that we do not 
lose generality requiring a, b to be small enough to satisfy a < 1/T, b <1/0, and L 
prime. □ 

Theorem 5. [29, Theorem 3.1], [28] Let S C [0, T) x [—0/2,0/2} c R 2 be a compact 
set with measure p(S) < 1, such that S is (a, b, A)-rectified as in Definition 3 (with 
flT not necessarily smaller than 1). Then there a vector c £ C L , and the test signal 

nic = ^ \ Cn mod L dn/L: 
n 

such that for any H £ OPW(S) 

L -1 

h{x + t,t) = aL EE a j,q(Hui c )(x - a(kj + q)) 

3=0 geZ 

x r(x — akj) ip(t + a(kj + q)) e 2 ’ Klbn i t 

with convergence in L 2 (R 2 ). Here, the coefficients aj^ are uniquely determined by the 
choice o/{c n }, and r(t), ip(t) are any functions such that r{t — ak) and — bn) are 
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(a, e)- (respectively, (b,e)-) partitions of unity in time (respectively, frequency) domains, 
with s > 0 dependent on S. 

Since we can always rectify a compact S with measure p(S) < 1, Theorem 5 
holds for a wider class of regions, namely, of all regions S whose so-called Jordan 
outer content is less than one [29] . 

2.2. Stochastic operator Paley-Wiener spaces. Let H be a stochastic operator 
with integral representation 

H f = Jfv(t,v) M„T t /didi/, 

and stochastic spreading function rj(t,v) a zero-mean random process such that 
€ L 2 (R 2 ) for all w e fl. We denote the space of all such stochastic 
processes by StL 2 (R 2 ). The autocorrelation of the spreading function is given by 

R v (t, V] t', v’) = E{Tj(t, v) T](t\ v')}. 

Definition 6. We say that H is a stochastic Paley-Wiener operator bandlimited to U, 
whenever the support of R v (t , v\ t!. v') is contained within a closed set U C R 4 , that 
is, 

StOPW(E/) = |ff: L 2 (R) —> StL 2 (R): supp R v (t, v\ t\ u') C U with U closedj. 

In this section, we always assume U already rectified, as done in the deterministic 
case. 

The symmetries of the autocorrelation function require a symmetric rectification, 
defined below. However, it will not cause any confusion that whenever we speak of 
a rectified 4D region, we always mean a symmetrically rectified one. 

Definition 7. The set U is (a, h. A)-symmetrically rectified if it can be covered by 
the translations A = {Aj = (kj. rij. /c', n'-)} _ 0 of the prototype parallelepiped 

□ 2 = [0, a) x [0, b) x [0, a ) x [0, b) along the lattice (aZ x bZ) 2 

L 2 -1 

U C [J Cl 2 + ( akj, bnj, akj , &n') 

3=0 

such that the 4D volume of D 2 is small: ab = L is prime, and the right-hand side 
is a symmetric set. 

It is easy to see that the above requirements imply that the volume of U satisfies 
p(U) < 1, and conversely, it can be shown with little work that any symmetric 
compact set with Jordan content less than one can be rectified with a sufficiently 
large L [8]. This restriction on the area is crucial for operator identification. Before 
giving results for general operators whose autocorrelation functions are supported 
on arbitrary sets U C R 4 , we look at the sets of a special kind, where U = S x S. A 
general case will be considered in Section 2.4 below. 

2.3. Sampling of stochastic operators supported on S x S. Under the special 
circumstance that U can be represented as a product S x S of some set S' in R 2 , 
or rather, if we assume U to be (a, b, A)-symmetrically rectified, A = T xf for 
some T c Z x Z such that |T| = L, the operator (via its spreading function) can 
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be reconstructed directly from the output of the weighted delta train input with an 
explicit formula similar to the one presented by Pfander and Walnut [31]. 

We define the non-normalized Zak transform Z: L 2 (R) —»• L 2 ([0, aL) x [0, b )) as 

Zf{x, = f( x ~ anL ) e 2maLnv . 

n£Z 

We say that a series of random processes x n(t) converges to x(t) in mean- 
square sense 

N 

x(t) rn =' y^ x n (t) O lim E{|aj(t) — V] x n (t) | 2 } = 0. 

zJ n—>■ oo z ' 

n£Z n=—N 

Theorem 8. Let H £ StOPW(S' x S) such that the compact set ScR 2 has measure 
p(S) < 1. Then there exist L prime, a,b > 0 with ab = jj, a complex vector c £ C L 
and a sequence {otj p }f p= i depending only on c such that we can reconstruct H from 

its response to an L-periodic c-weighted delta train m c = Y) c k (mod L) dak via 

fee z 

V(t, v) m = aL yj £ a jp e~ 2 ^- bn ^ +k ^Xn{f u) 

j =o p=o 

x (Z aL Hm c ) (t + a(p - kj),u - bnj), 

where the translations y n (f + ak, v + bn) generate an (a, b, efpartition of unity in the 
time-frequency domain. 

This means that it is always possible to find c such that any two operators 
from StOPW(S' x S) can be distinguished from their response to the pilot signal 

nic = Yj 0-k (mod L) <^afe* 
fc(zZ 


Proof Let a,b> 0 , L - prime with ab = ^ be fixed numbers to be chosen later. This 
choice will depend on the support of rj(t, v). Let c £ C L ; indices of c should always 
be understood modulo L. 


Hm c (x) 


tj(t, 7 ) e 2 ™ 7 * in c (x-t) dtdy 

V (t,y) e 2 " 7 * E CkS(x — t — ak) dt dy 

fee z 


= / c fc r?(x - ak, 7 ) e 2mix dy 
^ kez 

= E Cfe +P / *70- a(k+p),y) e 2mix dy, 
fee z ^ 

with all the equalities holding w-surely, and the last equality being true for arbitrary 
p £ Z. Applying Zak transform to both sides, we get 

Z(Hm c )(x, v) = ^ iTm c (x — anL) e 2manLv 

n£Z 

= E c *+p f r 1 ( x -a(k+ P +nL), 7 )e 2 ^ anLl ' + ^- anL ^ dy 
fc,n£Z ^ 
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substitute k = k + nL 

= £c fe+p / n(*-»(*+P), 7 ) e 2 ’^" 2 '^ d 7 

n(EZ 


by Poisson summation formula e lmnqx = q 1 ^ S(qx — n) with q = aL = 1 /b 


— "Y, °k+p j 

ri(x-a(k+p),'i)e 27Tn ' 1 —jr 'y ' 5(aL(v— j)—n) dy 


n£Z 

= "Ys °k+p j 

T}(x-a(k+p),y) e 2mix b Y^ S(v — 7 — bn) d 7 

fcez J 

n£Z 

carry out integration in 7 and set 

n = — n, k = —k 


= b^c P -kV(x — a(p — k), v + bn) e 2m (' J + bn ) x . 

fc,n£Z 

Substitute t = x — ap and observe in the exponent [y + bn)x = v(t + ap ) + bnt + f/P- 
For brevity, we define Z p (t, v) as 

Z p (t, v) = 6 _1 e - 2mu ( t + a P') ZHm c (t + ap, v) 

(4) = Y Cp-k e 2mpn/L n(t + ak, v + bn) e 27vibnt . 

For all t, v G □ and all a; G O we then have a mixing matrix equation 

(5) Z{t,v)= Y M "T fc cr/ fei „(f,^), 

fc,n£Z 


where Z(t, v) = [Z p (t, v)\ p Zq is a vector-valued function on (t, v) £ □. 

By Lemma 4, the set S can be (a, b, r)-rectified, that is, there exists a collection of 
indices F = {{kj,rij)}jZo suc h that r] kn (t,n) e 0 on (f, v) £ □ for any (k,n) £ T. 
Therefore, by Lemma 9 below, the infinite sums in (5) can be trimmed to finite sums 
to obtain 

Z(t,v)= Y M"T fe c rj k n (t, v) 

/c,n£Z 

(6) m =‘- Y M"T fe c rj k n {t, v) 

(fc,n)er 

= G\ r ri r (t,is), 

where G is the L x L 2 Gabor matrix of all time-frequency shifts of c £ C L given by 
(2), G| r is the submatrix of G corresponding to columns indexed by T mod L, and 


T7r(f, v) 


v ) 


(.kj,nj)£ r 


is a column vector of nonzero patches of iq(t, v) defined by (4). 

Without loss of generality, no two indices in T correspond to the same column 
of G, that is, {k, n) ^ (k/, n') mod L £ T for all (k, n) ^ ( k', n') £ V. Such collisions 
can always be avoided by choosing a different rectification (a', b', F') such that the 
entire support set S is within [0, a'L') x [0, b'L'), which can always be achieved using 
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Lemma 4. By assumption, T < L, therefore, G| r is invertible for some complex 
vector c € C L J Denote 

^ = (^lr) = [ a jp\j, P =o 

the inverse of G| r . The solution to (6) can now be found, giving 

r lk j ,n j ( t i v ) m = (G| r )' 1 -Z(f,^) 

L—l 

= aL e~ 27vivt Y Vjp e.~ 2nivap ZHm(t + ap, v). 

p =0 

We can now combine the patches rj k n (t, is) into the whole spreading function r/(t, is). 
In the mean-square sense we have 

L- 1 

V(t, v) m =' Y T >( t ’ v )Xa(t - akj,u - bnj) 
i =o 

L -1 

m = ' Y Vkj.nj (* - ak j 1 V - bn 3 ) e- 27Tlbni{t - akj) Xn (f - akj, v - bnj) 

3=0 

L—lL—l 

m =■ clLYY “jp e- 2ni M t+aip - k i»- bn * ap) Xn(t, v) 

j =o P =0 

x ZHm c (t + a(p — kj), v — bnj). □ 

Lemma 9. Let rj(t, is) be such that supp R v (t, is; t\ v') C S x S with Scl 2 that is 
( a,b,T)-rectified. Then for all (f, v) £ [0, a) x [0,6), 

L — l 

EE a k,n,i(ti v ) v{t ~ a(lL + k),v + bn) m = E« 7 (f, v) rj 7 (t, v), 

k —0 Z,n£Z 7(=r 

where r) (t, is) = r](t — a(lL + k), v + bn). 

Proof. Denote Q = Z/LZ x LZ x Z the set of all indices on the left hand side. 
Consider 

e{ie<v> 7 -EW} = E a T'i s ^ E { T ?7i^}- 

76*3 7 er 7 l, 72 SQ\r 

The rectification of It,, guarantees that 

E{r7 7l (ti,J/i)?7 72 (f 2 ,^)} = 0 

whenever either 71 or 72 are not in T. We conclude 

Y a-yVjit, v ) m =' E “7^7(*> ^)- D 

7GQ 7GT 

Remark. Since the autocorrelation functions of WSSUS operators have the special 
form 

R v (t, v] t', is') = S(t — t') S(is — is') C v (t , v), 

Theorem 8 is applicable to WSSUS operators whenever the area of the support 
of the scattering function (also known as the spread of the operator) satisfies 

t In fact, for prime L the set of c G C L such that every L x L submatrix of G is invertible is a dense 
open subset of C L [18]. Furthermore, all entries of c can be additionally chosen to have absolute value 


one. 
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p(supp C v (t, n)) < 1. However, it is intuitively clear that it is excessive to cover a 4D 
diagonal (a set of measure zero in R 4 ) with a single 4D parallelepiped of volume one. 
Indeed, covering it with a string of small parallelepipeds (as in Figure 2) is enough 
for identification and allows recovery of C v for supp C v bounded, of arbitrary size. 
This comes as a corollary from Theorem 13 and Theorem 16. 

2.4. Stochastic operators with non-tensored support. In this section we proceed 
to the most general case of stochastic operators. Consider an operator H with a 
spreading function rj{t,v) such that the autocorrelation function /i’. r/ (t, v\ t'. v') is 
supported on some arbitrary bounded set U in R 4 . We will see that in general it is 
no longer possible to reconstruct rj(t, v ) itself. For instance, this happens because 
with nonzero probability some instances r/(t , v. u>) may have spread larger than one, 
violating the necessary condition of the deterministic Theorem 5. Nevertheless, 
one may hope to recover Rr,(t, v,t', v') from the autocorrelation of the received 
information Rf(t,t'). 

To prove Theorem 12 below, we will need to solve equations of the form V = 
GXG* with both X. Y positive semi-definite.' To this end, we need a standard 
technique from linear algebra. Let vectorization vec: C raxn —» C n be the linear 
isomorphism between the space of matrices C nx?l and the space of column vectors 
C n ~ given by stacking of the columns 

(veC A)^ A.i mo d n,\}/n\ i i 0,. . . , Tl 1. 

The following identity relating vectorization and the Kronecker product of matrices 
is well known [36, 34]: 

(7) vec {AXE 1 ) = {A® B) vecX. 

For an arbitrary matrix A, the set = {(A, A'): A\ t y ^ 0} is called the support set 
of A. From the properties of positive semi-definite matrices it is easy to see that 

( 8 ) (A, A') £ A implies {(A', A), (A, A), (A', A')} C A. 

With some abuse of terminology, we call sets that may appear as support sets of 
positive semi-definite matrices, and hence satisfy ( 8 ), positive semi-definite patterns 
or, for short, spd patterns. 

Lemma 10. Let A be a fixed finite spd pattern, A C {(0, 0),..., (n — 1, n — 1)}, and 
let G £ C nxm . The following are equivalent: 

(i) For each positive semi-definite Y £ C mxm , there exists a unique X £ C nx " such 
that a) X is positive semi-definite, b) supp AT = A, and c) Y = GXG*. 

(ii) If a Hermitian matrix N £ C" x " with supp N C A solves the homogeneous 
equation 0 = GNG*, then N = 0. 

(Hi) The matrix G ® G| a has a left inverse (is full rank). 

Proof, (i) =>• (ii) By contraposition, let there be 0 ^ N £ C nxn such that GNG* = 0; 
let E be the diagonal matrix whose Ath diagonal entry is one if (A, A) £ A and 
zero else. Then there exists a positive real number C (for example, Gershgorin 
circle theorem guarantees C = ||iV|| = sup 1<i<m Y^j=iWij\ < 00 w i^ be enough) 
such that both CE + N and CE are positive semi-definite, and G(CE + N)G* = 
G(CE)G* + GNG* = G(CE)G*, thus violating the uniqueness of X in (i), as both 
supp (CE 4- N) and supp N C A. 


1 An hermitian matrix X £ C nxn is positive semi-definite if for any a S C n , a*Xa > 0. 
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(ii) =>■ (i) Suppose, that there exist X-\ ^ X 2 , both positive semi-definite, sup¬ 
ported on A, such that GXiG* = GX 2 G*. Then N = X- t — X 2 ^ 0 is necessarily 
Hermitian, supp N C A, and GNG* = 0, a contradiction. 

(iii) => (ii) Let an Hermitian matrix N be supported on A and be a solution to 
0 = GNG*. Applying vectorization to both sides of 0 = GNG*, we get by (7) 

(9) vec 0 = (G ® G) vec N, 

If G (g> G| a is invertible, (9) implies N = 0. 

(ii) =>• (iii) Let A £ C mxm be an arbitrary square matrix supported on A such 
that G <g> G| a vec A = 0, that is, GAG* = 0. The Cartesian decomposition of A is 
given by A = Hi + iH 2 with both H\,H 2 Hermitian, defined by 

Hi = t^{A + A*), H 2 = ^(A-A*). 

It is easy to see that both supp Hi, supp H 2 C A, and GH\G* = GH 2 G* = 0, since 
GA*G* = (GAG*)* = 0. Therefore, by (ii), Hi = H 2 = 0 , and A = 0. It follows 
that vec A = 0. Since vec A is arbitrary, it follows that the columns of G Q G | A are 
linearly independent, that is, G <3 G| a is left invertible. □ 


Definition 11. We would say that a spd support set A is a permissible pattern if 
some cGC l generates a Gabor frame G = [M"T fc c]f ~= 0 such that the equivalent 
conditions of Lemma 10 are satisfied. If an spd pattern is not permissible, it will be 
called defective. 

This designation reflects the emergence of these patterns as those which permit 
the sampling of operators with delta trains. 


Theorem 12. Let H £ StOPW((/) such that U is (a, b , A)-rectified for some a,b> 0 , 
|A| = L 2 , and ab = l/L. If some c £ C L generates G = [M”T fe c]f n ^ 0 such that the 
submatrix (G ® G)|a is (left) invertible, then we can reconstruct the autocorrelation of 
the spreading function E{r/rj) from the autocorrelation Rf = E { / /} of the response 
f = iTm c of H to the L-periodic c-weighted delta train m c = Ck mo d l $ak with the 


reconstruction formula 


L 2 -1 L—l 

R rj (t,m,t , ,v') = b - 2 E 

3 = 0 P,P'= 0 

do, x £ g —2 7T i a ( v (k j + m L + p ) — v' ( k j + m' L + p ')) 

m,m tZ 

x Rf(t — a(kj + rnL — p), t' — a(k'j + m'L — p'). 

Proof. Again, as in the deterministic case, we start with the support already rectified 
in the sense of Definition 7. We proceed in the same manner as in the direct product 
case until the mixing formula (5), which guarantees that for p = 0,..., L — 1 for all 
(f, v) within the base rectangle □ = [0, a) x [0, b) 


Z(t,v)= E M ” Tfcc Vk.nM, 

fc,n(EZ 
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Taking autocorrelation on both sides, we get for all p,p' = 0, ...,L — 1, and 

(f,*'), (i'V) G □, 

E{Z p (t, v) Z p ,(t',i/)} = E{]T(M-T k c) p r lKn {t 1 z/)£ (M"'T k 'c) p , Vk , n ,(t’, v')} 

k,n£%j fc'n/GZ 

= E^ M ” Tfcc )p (M"'t*'c) p ,e {n kt n(t, v) r? Kn ,{t'y)} ■ 

fc,n,/c'n'£Z 

Let supp R v (t, v\ t\ v') be covered by L 2 4-dimensional parallelepipeds indexed by 

A = {(k , n, k', n')}, that is, 

Rr,{t,u\t\v') = ^2E{r] kn (t — ak, v — 6n) rj kW {t' - ak',u' - bn')}. 
(fc,n,/c'n')£ A 

Without loss of generality, all (A:, n) and (A:', n') are distinct modulo L. 1 For brevity, 
let Tj be the translation 

7 v\ t\ v’) = f(t — akj, v — bnj,t' — ak ', v 1 — 6n'). 

Let us denote Y p y = E {Z P Z*,} and X k ^ Kn > = E{r) kn Ti* k , n ,} , where * stands 
for conjugate transpose. As covariance matrices of zero-mean random vectors, 
both Xk, n ,k'n' and Y p y are positive semi-definite, and conversely, every positive 
semi-definite matrix is a covariance matrix for some random vector [23]. With this 
notation, we write for each (t, v), (A', v’) £ □ a deterministic matrix equation 


(11) Y = GXG*, 

where G = [M"T fc c] is a Gabor matrix as in (2). 

To have a a unique positive semi-definite solution X of the underdetermined 
system of equations (11) with an arbitrary positive semi-definite Y, by Lemma 10 
it is necessary and sufficient that G g) G| a is left invertible. Let A denote its left 
inverse, 

A = la(k,n),( P , P ')]k~} p y=o such that A (G ® G| a ) = Id • 

Such A may exist only if |A| < L 2 . 

The autocorrelation of the channel spreading function can be recovered from X 
by observing (starting with the definition (4) of r] k n ), 


Rr,(t, v’) = E{i 7 (f, v) v ')} 

L 2 — 1 

= Y, TjX(t,w,t’,p%, njlkj , nj e- 2 ™^- v ' k 'j) 


( 12 ) 


i=o 
L 2 -1 


= Y( A lvec 7 e 2nla( 


iskj — is'kj) 


j =0 

L 2 -! L-l 


1=0 p,p ’=0 


tAs in the deterministic case, the parameters a, b, L can always be chosen in such a way that 
supp R v {t, i/; ti /') C [0, aL) x [0, bL) up to a translation. 
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where we construct Y from the autocorrelation of the received signal f(t) = Hm c (t) 
via 


Y p y (t, !/; t\ v') = E{z p (t, v) v')} 

= b ~ 2 e -2vr ia^p-Yp') E { Z f(t + ap, v) Zf(t' + ap', z/)} 

_ ^—2 ^— e 2'Kia(vp—v'p) ^ ^ ^ — 2nib ~ 1 (rnv—m'v') 

m,m 

x E{/(f + a(p — mL )) f(t' + a(p’ — m’L))}. 

Translating and simplifying, we get 

Y p y (t — akj , v — bnj ; t' — akj , v' — bn ') 

_ jj— 2 g2Tviab(njp—n'jP ) ^ ^ 2 / 7ria((p+mL)i>'— (p'+m'L)!/') 

m,mtZ 

x Rf(t — a{kj + mL — p),t' — a(kj + m'L — p). 

Upon substitution of the above back into (12), we get the desired reconstruction 
formula (10). This completes the proof of Theorem 12. □ 

If the support of can be factored into a tensor square of some set of area less 
than one on the time-frequency plane, then Theorem 12 guarantees reconstruction 
of R v from the autocorrelation Ilf of the received measurement H m c , which is a 
weaker result than Theorem 8. To wit, assume that R v is supported on a product set 
S x S such that S' x S is (a, b, A)-rectified, and that the area of S is less than one. It 
follows that A itself can be represented as a direct product of some index set, say, 
A = T x T such that S is (a, b, r)-rectified. For some vector c the submatrix of its 
time-frequency shifts Gr is left invertible [29, 18]. Then (G <S> G)|a = Gr <8> Gr is 
also left invertible, and R v (t, v\ t', v’) can be recovered from Rf(t, t'). 

The strength of Theorem 12 is that it allows to exploit information about more 
complicated dependencies between scatterers manifested in the geometry of the 
support of the autocorrelation function R v (t, v. t', ;/). 


(f>') (t> 0 




Figure 1 . Different tjqjes of support sets of autocorrelation functions. 
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(*>') 


(t,v) 

(a) wssus 


(t> ') 




Figure 2. Different types of support sets of autocorrelation func¬ 
tions, WSSUS case. 


For example, consider the important case of the WSSUS operators, already 
mentioned in the Lemma 2.3 after Theorem 8. Let H hlg be some WSSUS operator 
whose scattering function C v (t, v) is supported on a 2D rectangle S'* 31 ® = [0,1) x [0, L). 
This rectangle S' 1318 of area greater than one can always be rectified with a collection 
A blg of L 2 translations of a box [0,1) x [0,1). From the WSSUS assumption we know 
that Rr,(t, v ; t\ v') = 0 whenever ( t , v) and (t\ v') are in different boxes, therefore, 
the 4D set supp R^it, w, t', v’) is (1, j-, A blg )-rectifiable, as shown in Figure 2b. It 
follows that in the sense of Theorem 12, H blg is identifiable whenever the diagonal 
set A blg is a permissible pattern. Since, according to Theorem 16, this is always the 
case with any such diagonal set, we obtain the following corollary of Theorem 12. 

Theorem 13. Let H € StOPW(5' x S) a WSSUS operator with S = supp C(i, v) 
a compact set of arbitrary finite measure p(S) < oo. Then there exist L prime, 
L > p(S), a, b > 0 with ab = 1 /L, a complex vector c £ C L and a sequence {ctj P }j P= 1 
depending only on c such that we can reconstruct the scattering function C(t, v) of 
H fi'om the autocorrelation of its response to an L-periodic c-weighted delta train 

IIIc = ^ C/c mod L^ak Using (13). 

fcez 


Proof For an arbitrary e, it is always possible to find a, b > 0, -4 > yjp(S) + £ such 
that the support of the scattering function S is covered by N translations of the 
rectangle [0, a) x [0, b ) (as usual, indexed by A), such that p(S) < Nab < p(S) + e. 
Without loss of generality, all (k,n) £ A are distinct modulo L = J,. We cover the 
4D diagonal of the set S x S with N 4D parallelepipeds of volume 1 /(ab) 2 , so the 
total volume of the cover is -^ < 1. By Theorem 12, there exists c £ C L such that 
we can reconstruct the autocorrelation of the spreading function from the response 
f = Hm c using a version of (10) that takes advantage of the stationarity of H and 
periodicity of m c : 


( 13 ) 


L 2 -1 L—l 

C{t,v) =b ~ 2 Y, Y, Y a hP’P' e 2nia ^ p - p, '>^ +bn ^-' rnL] 

j =0 p,p'=0 m^lu 

x Rf(t — a(kj — p), t — a{kj + m'L — p'). 


□ 
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3. Permissible patterns 

The preceding discussion shows that it is ultimately important to study which spd 
patterns A are permissible, that is, for which sets A there exists c £ C L such that 
G ® G| is full rank. Consider the spreading function r/(t, v) of H given by 

L -1 L—1 

‘Hit, = V^ni 1 ~ka,v~- nb). 

k—0 n—0 

with nk,nit,v) £ L 2 (R 2 ) supported on [0, a) x [0,6). Due to the specifics of the 
underlying time-frequency analysis, it will be convenient to index the matrices with 
the finite index set J given by 

(14) J = {(0,0), (0,1),..., (0, L — 1), (1,0),... , (L — 1, L — 1)} . 

We call the autocorrelation pattern of r) the indicator matrix ACP £ {0, 

if for some {t,v), (; t\v ') £ v) z/)} ^ 0 

otherwise, 

= ( k',n '), A, A' £ J. Clearly, ACP must be symmetric, 
moreover, just as in (8), 

(15) ACP(A, A') = 1 implies ACP(A', A) = ACP(A, A) = ACP(A', A') = 1, 

and conversely, for any matrix A £ that satisfies (15), there exists an operator 

with the spreading function rj A (t , v\ t\ v r ) whose autocorrelation pattern is A. We 
visualize autocorrelation patterns with diagrams such as Figure 3, where shaded 
boxes correspond to nonzero correlation between patches. 

Lemma 10 indicates that the problem at hand is linked to the Haar property of 
Gabor systems. We explore this connection in more detail in Section 3.3. The Haar 
property of a finite-dimensional Gabor frame reads that any L columns of a generic 
Gabor matrix G are in general linear position. By the result from [18], this holds 
for almost every G with L prime. Therefore, any deterministic spreading function 
supported on L boxes of area 1/i on a time-frequency plane can be identified. In 
other words, any set T c J such that |T| = L indexes a subset of columns of G 
that is linearly independent for almost every seed vector c. This contrasts with the 
stochastic setting, where we will see that there exist plenty of spd patterns that 
correspond to submatrices of G <8> G which are rank-deficient for every choice of c. 

Generally, G ® G can be viewed as a Gabor system on the non-cyclic group 
'Ll x 'Ll — J, generated by the window c.® c, 

G ®G = {7r (k,n,k',n')(c® c): 

{k,n),{k',n') £ J, n{k, n, k', n') = M"T fc c ® M n Vc}. 

The Haar property of G ® G would require all subsets of G ® G of order L 2 to be 
linearly independent, which is not the case for any prime number L > 2. However, 
the positive-definiteness of the autocorrelation function demands the autocorrelation 
pattern to satisfy property (15). This precludes certain subsets of G ® G from being 
tested for linear dependence. Below we show that this restriction implies that for 
L = 2 every spd pattern is permissible; not so for L > 3. 


ACP(A,A') = |q’ 
where A = ( k,n ), A' 
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3.1. Case L = 2. On Figures 3 and 4 we show all possible spd patterns for L = 2. 
In addition, the last pattern on Figure 4b, corresponds to a linear dependent set of 
elements of G (g> G. However, due to lack of symmetry, such a set cannot appear 
as a support set for the autocorrelation of the spreading function of the stochastic 
operator. We mention it here to highlight the connection of the stochastic operator 
identification theory with the analysis of Gabor frames on general abelian groups, 
for this example, Z 2 x Z 2 . Further properties of such frames, including this pattern, 
can be found in [17, 27]. 


(t'X) 



Figure 3. Tensor rank-1 autocorrelation patterns for L = 2. Any 
rank -1 tensor pattern is permissible by (16). 

(t'X) 




Figure 4. Other autocorrelation patterns for L = 2. 
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Interestingly, the only admissible patterns on L = 2 belong to one of the two 
types, shown on Figure 3 and Figure 4a. The first type contains sets that can be 
represented as rank-1 products^ of sets of order L in J, that is, there exists a set 
T or order |T| = L such that A = T x T. Such product patterns inherit the linear 
independence properties of their factors, since the Haar property of G guarantees 

(16) rank (G ® G| rxr ) = (rank Gr ) 2 = L 2 . 

The second type, all boxes on the diagonal, of maximal possible tensor rank, is also 
a permissible pattern for L = 2, as we observe the determinant of the matrix 

det(G<g>G| d . ag ) = 4(|c 0 1 4 - |ci| 4 )(cgcl 2 - c\cfr) fr 0 

or almost all choices of the generating atom c = [co ci]‘. 

This concludes the analysis of the L = 2 case with a happy ending: 

Proposition 14. Let a function R^it^u-fr'^v') be supported on a set of measure 
less than or equal to one covered with 4 boxes D 2 + (kja,njb,kja,n'jb) for some 
{(kj,rij,kj,nj) £ J x and some O 2 = [0, a) x [0, b) x [0, a) x [0, b) such that 

ab = !/2 and all (k,ri), (k 1 ,n') distinct modulo 2. Let rj(t,i/) be some function with 
R v (t, t', v’) as its autocorrelation function, and H a stochastic channel with p its 
spreading function. Then we can recover R ri (t. u; t\ v') from the response of H to the 
sounding signal 

m c (f) = Co S(t — a — 2 am) + Ci S(t — 2 am) 

m m 

for almost all c = [c 0 cff £ C 2 , |c 0 | = |ci| = 1. 

3.2. Case L > 2. Classification of all autocorrelation patterns with L = 3 already 
presents some challenges. For once, there are over 5000 possible spd patterns 



Here, 1 corresponds to the diagonal case, plus there are (_) choices of 7 boxes on 
the diagonal, any two of which can be correlated corresponding to the ( ( ) factor, 
etc . 1 

The problem of classifying all possible arrangements of boxes becomes intractable 
very quickly with L. In Section 3.3, we show that whenever some A is a permissible 
pattern for almost all c, there is a related (via the permutations of the Gabor 
elements) family of A CT that will be permissible patterns for almost all c. Such 
observations simplify the classification problem, although they do not suffice to give 
a complete classification. 

Secondly, alas, unlike L = 2, some spd patterns correspond to rank-deficient 
subsets of G 0 G. That is, there are sets that satisfy ( 8 ) but are not permissible, for 
example, see Figure 5. It turns out that there are structural reasons for patterns on 
Figure 6 and Figure 5 to be permissible (respectively, defective). 

With little effort it can be seen that patterns with tensor rank 2 (as on Figure 5) 
can never be permissible, owing solely to the properties of the tensor product 

h/Ve say that an element b g S ® S has tensor rank k if k is the smallest number with the property 
that there exist oi, ai,... , a^, bi, & 2 , • • ■, £ S such that A st oi ® 6i + • • • + ak ® 

*The case of even number of boxes on the diagonal is always counted within the larger odd case; by 
symmetry considerations, every correlation between boxes adds two boxes on the field). 
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it'y) 



Figure 5. According to Proposition 15, any rank-2 pattern is not a 
permissible pattern. 


space and not to the specifics of the underlying Gabor structure. In fact, for any 
L, permissible patterns cannot contain two complete large sets of pairwise tensor 
products. (Here, such two sets are {^oo^oi} an d { t 7 o 2 > t 7 io}> an d i n this context, 
large means that # {rj 00 , rj 01 } + # {r] Q2 , r/ 10 } = 2 + 2 > 3.) 

Proposition 15. Let G € C nxm be an arbitrary matrix, and Gy, G 2 its submatrices 
comprising columns of G indexed, respectively, by lb and r 2 such that I\ D r 2 = 0. 
Denote A = (Ti x I'd) U (r 2 x r 2 ). JjT |Ti | -t- |r 2 | > rank G, then the set of elements in 
G ® G | is linearly dependent. 

Proof Since |rj_ | + |r 2 | > rank G, it follows that there exists [b t bff £ ker[Gi|G 2 ] 7 ^ 
0 , that is, 

Gyby + G 2 & 2 = 0. 

Now consider By = by <g> by, B 2 = 6 2 6 2 . Both are Hermitian, and 


G\BiG\ - G 2 B 2 G* 2 = (G 1 6 1 )(G 1 6 1 )* - (G 2 & 2 )(G 2 & 2 )* 

= (GrfeOCG^r)* - (-Gyb^-GJ ,)* = 0. 


This means that we have found a Hermitian matrix 


N = 


By 

0 

0 


0 0 
b 2 0 
0 0 


supported on A such that GNG* = 0 and, hence, G ® G| is linearly dependent. It 
follows that A is not a permissible pattern. □ 


On the other hand, the patterns with maximal tensor rank (that is, diagonal 
patterns) will always be permissible. This corresponds to the important case of 
WSSUS operators. We give here an elementary proof for finite dimensions. (See also 
[5, Theorem 3.1] for a discussion of this in the realm of Hilbert-Schmidt operators 
in infinite dimensions.) 
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Theorem 16. Denote n(k,n) = M"T fc . Let G = {x{k,n)c} k Yo be a Gabor frame 
generated by c. Then for almost all c G C L , the set G (g> G| dia? of all tensor products of 
each Gabor element with itself 

G ® G \dia g = n(k,n)c}%~l 0 

is linearly independent, that is, for almost all c G C L the diagonal set 

A-diag — {{b, n), (fc, n)} k n=0 

is a permissible pattern. 

Proof It is a straightforward observation that the linear independence of the set 
G® G| diag G C jxj is equivalent to the linear independence of the family of the 
corresponding finite-dimensional Hilbert-Schmidt operators P k n : C L —> C L given 
by 

Pk.nX = ( x , 7 T (k, n)c) n(k, n)c. 

Clearly, P k , n = (M n T fc )P 0) o(M"T fc )*. From the spreading function representation 
of IT: C L C L , 

N-l 

H= Y v\p^W^ q 

p,q=0 

it is easy to see with the help of the commutation relation T ,: M n = e- 2r ' <: "M , 'T l: 
that for any H we have 

L —1 

(M"T‘)il(M”T 1 )* = Y {M. (k ’ n) r]\p,q])M p T q , 

p,q=0 

where yf k ' n ' ) ri[p,q\ = e 2m ^ gk ~ pn ' > r}\p,q]. In particular, the spreading functions of 
P ki n and P 0 ,o satisfy ip~, n = Therefore, the linear independence of the 

family of operators {Pk,r,} k n L 0 C HS(C L ) is equivalent to the linear independence 
of the family {M( fe ’")? 7 o,o} C C i2 . 

In finite dimensions, the short time Fourier transform of c with respect to itself 
takes form 

V c c\p, q ] = (c, M P T 9 c) = "Y, e~ 2nipr ^ L c[r) c[r — q\. 

r 

Here and in what follows, the summation is over Z L and all the indices of vectors 
c, x G C L are taken modulo L. We compute 

Popx[m] = (x, c ) c[m] = Y] x \o\ <%] c\m\ 

q 

= x[m — q] c[m — q] c[m\ 
q 

= x[m — q] Y^ &[ r — m ] C V ~ o\ c H 

q r 

= Y - <A Y ( \ E e^ iv{r ~ m)IL ) c[r - q] c[r} 

= EE(^E e -277ipr/L c j r j -j r _ e 2ivimp/L ^ ^ 

p q r 
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= £E( ^V c clp,q])wT*x[m], 

v q ' ' 

which proves that 770,0 [p, g] = g]. 

We claim that for almost every c £ C L , V c c has full support. For a fixed pair 
p, q £ Z L x Z L , the set of solutions Z p , g = {c £ C L : V c c \p, g] = 0} is a manifold 
of zero measure in C L . Hence, V c c has full support almost everywhere, namely 
whenever c £ C L \ (J Z Pyq . The proof is complete by observing that whenever 
?7o,o has full support, the family {M^ fc ’ n )?7o,o}(fc,ra)ez i xz i is linearly independent in 
C L \ □ 


(*>') 



Figure 6. By Theorem 16, all diagonal patterns are permissible for 
almost all c. 


(i'X) 



Figure 7. Defective autocorrelation pattern on T = 5. Total area 
16/25 leads to a 16 x 25 matrix of rank 13. 

Another source of deficiency that begins to appear only with L > 4 is illustrated 
on Figure 7. 
























































Sampling of stochastic operators 


23 


Proposition 17. Let the height (or, equivalently, the width) of the pattern A exceed L, 
or, formally, for some A 0 G A, 

#{V: (A 0 ,A')gA}>L. 

Then A is not the permissible pattern. The matrix G <g» G| a is singular for all c G C L . 

Proof Let T = {A': (Ao,A') G A}. Then |T| > L, therefore, the set G| r is linear 
dependent. Hence, we can find a nontrivial vector a G ker G\ y , We now have 
( G <g» G)a = G ® Ga = 0. That is, we have found a nontrivial linear combination 
O'iPi = 0 , and 

y a~g~ ®gi = (ffi® ffi) = 0. 

igt ier 

The theorem immediately follows from Lemma 10 by observing that whenever 
there exists a non-trivial A supported on A, not skew-Hermitian and such that 
GA = 0, (here, A = [a 0]), then a non-trivial Hermitian matrix A + A* satisfies 

G(A + A*)G* = 0. □ 

The existence of defective spd sets shows that one must be careful when trying to 
reconstruct the autocorrelation of the spreading function by sampling an operator 
with the delta train. Luckily, the task of weeding out defective patterns is uncoupled 
from the sampling procedure. All defective patterns A bad can be discovered numer¬ 
ically and inexpensively by testing a Gabor matrix generated by a random vector 
c. It is easy to see that the rank deficiency of G (g> G | A will (with probability one) 
indicate whether A is good or bad. 

Remark. Theorem 12 gives a procedure to recover E{r) rj} from the autocorrelation 
E{//} of the response / = Hm c of H to an L-periodic c-weighted delta train 
m c = Sfcez Cfc mod L <5 ak ■ The result is based on finding a permissible rectification of 
the set U . If some rectification satisfies the symmetry conditions for autocorrelations, 
but is not permissible, one can seek alternative (possibly finer) rectifications with 
the hope that one of them is permissible. However, Propositions 15 and 17 indicate 
that for some sets U there are no permissible rectifications, hence, Theorem 12 does 
not apply to StOPW(f/). 

Indeed, if for some (to, vq), we have p(K{r)(to,v<f) rj(t',v')}) > 1, then every 
rectification will have the defect discussed in Proposition 17, and our procedure to 
recover R v (t, u; t', v') is not applicable. 

Similarly, if for two sets S 1 ,S 2 we have p(S i) + g(S 2 ) > 1 and (Si x Si) U (S 2 x 
S2) C U. Consider U be (a, b, A)-symmetrically rectified, and S( be the induced 
(a, b, Ti)-rectification of Si, and S' 2 be the induced (a, b, T 2 )-rectification of S 2 \ S£. 
(Note that T 2 is not empty unless S 2 C S(, but then g(S[) > 1, and the rectification 
is again defective by Proposition 17). Clearly, Ti flT 2 = 0, (Ti x Ti) U (T 2 x T 2 ) c A, 
and p(S'i) + /i^) > p(Si) + g(S 2 ) > 1, and Proposition 15 applies. 

This observation does not imply that there exist symmetric U with 4D volume 
less than one and the property that no test signal g allows to recover £{ 7777 } from 
the autocorrelation E{Hg Hg}. In fact, recovery may be possible using a different 
type of a pilot signal, for example, a non-periodic delta train. 

3.3. Equivalence classes of permissible patterns. Let S J be the symmetry group 
of all permutations on the group J of order L 2 defined in (14). 
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(t'X) 



(*>') 
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Figure 8 . Three homologous patterns for L = 3. 


Definition 18. We call two spd patterns A and A a on the grid J x J homologous 
whenever there exists a permutation a e such that 

(A, A') e A W)),(rM)eA J . 

Two homologous patterns A and A a are equivalent if for almost all choices of the 
window c € C L generating G, 

rank G <8> G| a = rank G (g> G| a „. 

For example, the patterns on Figure 8 are all homologous, with the first two 
provably equivalent, according to Proposition 19 below. 

Numerical evidence shows that linear independence of the subsets of the tensored 
Gabor frame G <g> G is invariant under homology in the sense of Definition 18, for 
example, all the patterns on Figure 8 are permissible, as tested on a large number 
of randomly chosen c. Also, for L = 3,5, and 7, entire orbits of patterns {A a \ IJ(?s j 
are permissible. Additional indirect support to the hypothesis that any two patterns 
that are homologous with respect to the permutation of the Gabor atoms have the 
same linear independence status for almost all c comes from the equivalence of all 
patterns for the case L = 2 (see Figure 3) and the universality of Theorems 15, 16 
and 17 with respect to the permutations of the Gabor atoms. 

We will describe the permutations a € S J such that A and A a are provably 
equivalent for any A for almost all c £ C L . Clearly, all such permutations form a 
subgroup of S J . It remains an open question whether this subgroup is the whole 
group S J . 

For sake of notational simplicity, let us identify the atoms of a Gabor frame 
G generated by a window c £ C L with the elements of the torus Z L x Z L . The 
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(k,n) th atom g = M"T fc c = 7r(fc, n) c would correspond to ( k,n ) G Z^ x Z^, where 
finite-dimensional operators M and T are defined in (3), and n(k,n) = M ra T fc . 

Proposition 19. Let A denote the group of permutations a G S J such that A and A a 
are equivalent for all spd patterns A C J for all c € C L , except maybe for a set of 
measure zero. 

a) translations of the torus a a {k, n) = (k + q,n+p ) mod L belong to A for all p, q G Z. 

b) reflection of the torus Ob(k, n) = (— n, k) mod L belongs to A. 

c) rotation of the torus a c {k, n) = (k, —n) mod L belongs to A. 

For an illustration of these transformations in the case of Z 4 x Z 4 , see Figures 9 
and 10 . 

Proof Note that the linear independence of the subset Ga of elements of G is 
invariant under scaling the atoms by scalars p\, complex conjugation, and any 
invertible linear transformation T. Let G = [M ra T fc c]f”^ 0 . First, we construct 
several Gabor frames closely related to G. 

a) It is easy to see that the Gabor frame G a constructed from the atom c a = Pa (c) = 
M P T 9 c is a column permutation of G up to constant multiples of columns by 
G = e 2mpk . Indeed, 

7 r(fc, n) c a = M"T fc (M p T 9 c) 

_ ]y[” g27ripfc]yprpfcrp gc 
_ e 2nipky[n+pr£k+q c 

= C a n(k + q, n + p)c. 



Figure 9. Actions of the time-frequency shift (a) and conjugation 
(b) are translation and horizontal reflection, respectively. 


b) Similarly, constructing the Gabor frame Gb with the Gabor window being the 
Fourier transform of the atom q, = ipb(c) = Tc produces a Fourier image of the 
original Gabor matrix. This holds since the Fourier transform commutes with 
time-frequency shifts in the following sense: 

7 r(fc, n)c b = M”T fe Tc 

= k c) 

= JG( e 2™fcn M fc T —n c ) 

= Cb n, k)c. 
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The Fourier transform is a unitary operation which acts on the Gabor matrix 
from the left, hence it does not change the linear independence of the columns, 
scaling of columns by the constant Cb notwithstanding. In other words, Gb is 
a frame that is unitarily equivalent to a particular permutation of G, namely, it 
corresponds to rotating the torus, see Figure 10 [6, 35]. 

Curiously, the vertical flip operation Icj = c_ 3 also creates an equivalent 
pattern. This can be understood by observing I = T 2 . This corresponds to the 
reflection of both rows and columns of the torus x r Lj J . 



Figure 10. Action of the Fourier transform is 90° rotation. 


c) Another operation that preserves linear independence is conjugation. Let the 
Gabor frame G c be generated by the window c c = <p e (c) = c. Then G c contains 
all the atoms of G in the order that corresponds to the horizontal reflection of 
the torus group on itself. Note that taking conjugation does not destroy the linear 
independence of the vectors. 

Now let A be any spd pattern. From the above constructions of the Gabor frames 
G a ,a = a, I), c, it is evident that for all generating atoms c a = <p a (c) £ C L , 
rank G a 0 G a | A „ Q = rank G 0 G| a . For any a = a,b,c the transformation 
ip a : c i-> c a is a bijective mapping C L — > C L , therefore, if A is permissible for 
some c, then A" is also permissible (for some other c), and moreover, if A is permis¬ 
sible for all c £ C L except a zero set Z, then A CT is also permissible for all c £ C L 
except a possibly different zero set Z a . And conversely, if A is defective, then A" is 
also defective. Since there are finitely many permutations a, the union of all bad 
sets (Jo-es-z zG has measure zero, and it follows that A and A° are equivalent. □ 
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4. Conclusion 

We show that a large class of stochastic operators can be reconstructed from the 
stochastic process resulting from the application of the operator to an appropriately 
designed deterministic test signal. Our results are based on combining recently 
developed sampling results for deterministic band limited operators [16, 29, 24] 
and the sampling theory of stochastic processes [19, 23]. The classes of stochastic 
operators considered here are characterized by support constraints on the autocor¬ 
relation of the stochastic spreading function of the operator. Our results do not 
necessitate the frequently used WSSUS condition, nor the so-called underspread 
condition on operators. Moreover, we show that in some cases when the operator 
cannot be fully determined from its action on a test signal, still, the second order 
statistics of the spreading function, that is, its autocorrelation can be determined 
from the operator output. While in the deterministic case the possibility of operator 
reconstruction only depends on the support size of the spreading function, we show 
that in the stochastic case geometric considerations play a fundamental role for 
reconstruction. 
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